Boosting Zero-shot Learning via Contrastive Optimization of Attribute Representations

Zero-shot learning (ZSL) aims to recognize classes that do not have samples in the training set. One representative solution is to directly learn an embedding function associating visual features with corresponding class semantics for recognizing new classes. Many methods extend upon this solution, and recent ones are especially keen on extracting rich features from images, e.g. attribute features. These attribute features are normally extracted within each individual image; however, the common traits for features across images yet belonging to the same attribute are not emphasized. In this paper, we propose a new framework to boost ZSL by explicitly learning attribute prototypes beyond images and contrastively optimizing them with attribute-level features within images. Besides the novel architecture, two elements are highlighted for attribute representations: a new prototype generation module is designed to generate attribute prototypes from attribute semantics; a hard example-based contrastive optimization scheme is introduced to reinforce attribute-level features in the embedding space. We explore two alternative backbones, CNN-based and transformer-based, to build our framework and conduct experiments on three standard benchmarks, CUB, SUN, AwA2. Results on these benchmarks demonstrate that our method improves the state of the art by a considerable margin. Our codes will be available at https://github.com/dyabel/CoAR-ZSL.gitComment: Accepted to TNNL

Learning to Prompt for Open-Vocabulary Object Detection with Vision-Language Model

Recently, vision-language pre-training shows great potential in open-vocabulary object detection, where detectors trained on base classes are devised for detecting new classes. The class text embedding is firstly generated by feeding prompts to the text encoder of a pre-trained vision-language model. It is then used as the region classifier to supervise the training of a detector. The key element that leads to the success of this model is the proper prompt, which requires careful words tuning and ingenious design. To avoid laborious prompt engineering, there are some prompt representation learning methods being proposed for the image classification task, which however can only be sub-optimal solutions when applied to the detection task. In this paper, we introduce a novel method, detection prompt (DetPro), to learn continuous prompt representations for open-vocabulary object detection based on the pre-trained vision-language model. Different from the previous classification-oriented methods, DetPro has two highlights: 1) a background interpretation scheme to include the proposals in image background into the prompt training; 2) a context grading scheme to separate proposals in image foreground for tailored prompt training. We assemble DetPro with ViLD, a recent state-of-the-art open-world object detector, and conduct experiments on the LVIS as well as transfer learning on the Pascal VOC, COCO, Objects365 datasets. Experimental results show that our DetPro outperforms the baseline ViLD in all settings, e.g., +3.4 APbox and +3.0 APmask improvements on the novel classes of LVIS. Code and models are available at https://github.com/dyabel/detpro.Comment: Accepted by CVPR 202

SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligence

Spiking neural networks (SNNs) aim to realize brain-inspired intelligence on neuromorphic chips with high energy efficiency by introducing neural dynamics and spike properties. As the emerging spiking deep learning paradigm attracts increasing interest, traditional programming frameworks cannot meet the demands of the automatic differentiation, parallel computation acceleration, and high integration of processing neuromorphic datasets and deployment. In this work, we present the SpikingJelly framework to address the aforementioned dilemma. We contribute a full-stack toolkit for pre-processing neuromorphic datasets, building deep SNNs, optimizing their parameters, and deploying SNNs on neuromorphic chips. Compared to existing methods, the training of deep SNNs can be accelerated $11\times$, and the superior extensibility and flexibility of SpikingJelly enable users to accelerate custom models at low costs through multilevel inheritance and semiautomatic code generation. SpikingJelly paves the way for synthesizing truly energy-efficient SNN-based machine intelligence systems, which will enrich the ecology of neuromorphic computing.Comment: Accepted in Science Advances (https://www.science.org/doi/10.1126/sciadv.adi1480

Higher radiation doses after partial laryngectomy may raise the incidence of pneumonia: A retrospective cohort study

BackgroundCurrently, studies have shown that a high dose of radiotherapy to the throat have various harmful and adverse effects on the patients’ laryngeal function, resulting in the development of pneumonia. This study aimed to explore how radiotherapy dose affected the probability of pneumonia following laryngeal cancer surgery.Materials and methodsA retrospective analysis was done on patients diagnosed with laryngeal cancer between 2010 and 2020 and were treated surgically and with postoperative radiotherapy in the same institution. This study included 108 patients in total, 51 of who were in the low-dose group and 57 of whom were in the high-dose group. Age, gender, the location of laryngeal cancer, the presence or absence of lymph node metastasis, and other demographic and clinical characteristics were collected, and the prevalence of postoperative pneumonia was compared between the two groups.ResultsThe total prevalence of postoperative pneumonia was 59.3%, but there was a significant difference between the two groups(high-dose group 71.9% VS low-dose group 45.1%; p=0.005). A total of 9.3% (10/108) of the patients had readmission due to severe pneumonia, and the rate of readmission due to pneumonia was significantly different between the two groups (high-dose group 15.8% VS low-dose group 2.0%, p=0.032). Additionally, the high-dose group’s prevalence of Dysphagia was significantly higher than the low-dose group’s. According to multivariate logistic modeling, high-dose radiation was a risk factor for pneumonia (OR=4.224, 95%CI =1.603-11.131, p=0.004).ConclusionPneumonia risk could increase with radiotherapy doses > 50 Gy in the treatment of laryngeal cancer. Therefore, we recommend that when the radiation dose surpasses 50Gy, doctors should pay particular attention to the lung health of patients with laryngeal cancer

Mechanism of homocysteine-mediated endothelial injury and its consequences for atherosclerosis

Homocysteine (Hcy) is an intermediate amino acid formed during the conversion from methionine to cysteine. When the fasting plasma Hcy level is higher than 15 μmol/L, it is considered as hyperhomocysteinemia (HHcy). The vascular endothelium is an important barrier to vascular homeostasis, and its impairment is the initiation of atherosclerosis (AS). HHcy is an important risk factor for AS, which can promote the development of AS and the occurrence of cardiovascular events, and Hcy damage to the endothelium is considered to play a very important role. However, the mechanism by which Hcy damages the endothelium is still not fully understood. This review summarizes the mechanism of Hcy-induced endothelial injury and the treatment methods to alleviate the Hcy induced endothelial dysfunction, in order to provide new thoughts for the diagnosis and treatment of Hcy-induced endothelial injury and subsequent AS-related diseases

Comparative epidemiology of gestational diabetes in ethnic Chinese from Shanghai birth cohort and growing up in Singapore towards healthy outcomes cohort

Background Gestational diabetes mellitus (GDM) has been associated with adverse health outcomes for mothers and offspring. Prevalence of GDM differs by country/region due to ethnicity, lifestyle and diagnostic criteria. We compared GDM rates and risk factors in two Asian cohorts using the 1999 WHO and the International Association of Diabetes and Pregnancy Study Groups (IADPSG) criteria. Methods The Shanghai Birth Cohort (SBC) and the Growing Up in Singapore Towards healthy Outcomes (GUSTO) cohort are prospective birth cohorts. Information on sociodemographic characteristics and medical history were collected from interviewer-administered questionnaires. Participants underwent a 2-h 75-g oral glucose tolerance test at 24-28 weeks gestation. Logistic regressions were performed. Results Using the 1999 WHO criteria, the prevalence of GDM was higher in GUSTO (20.8%) compared to SBC (16.6%) (p = 0.046). Family history of hypertension and alcohol consumption were associated with higher odds of GDM in SBC than in GUSTO cohort while obesity was associated with higher odds of GDM in GUSTO. Using the IADPSG criteria, the prevalence of GDM was 14.3% in SBC versus 12.0% in GUSTO. A history of GDM was associated with higher odds of GDM in GUSTO than in SBC, while being overweight, alcohol consumption and family history of diabetes were associated with higher odds of GDM in SBC. Conclusions We observed several differential risk factors of GDM among ethnic Chinese women living in Shanghai and Singapore. These findings might be due to heterogeneity of GDM reflected in diagnostic criteria as well as in unmeasured genetic, lifestyle and environmental factors.Peer reviewe

Design of Broadband and High Gain Microstrip Array Antenna

A broadband and high gain 16-element microstrip array antenna is presented in this paper. It is operating at 12.4GHz.The array antenna consists of double-layered substrates which are separated by a layer of air. The parasitic patches and pins are adopted to achieve broadband. The box-type reflecting plate is used to improve the gain. The measured results indicate that the impedance bandwidth is as good as 24.91% ( ) and the gain is 19.31dB

Leveraging Herpangina Data to Enhance Hospital-level Prediction of Hand-Foot-and-Mouth Disease Admissions Using UPTST

Outbreaks of hand-foot-and-mouth disease(HFMD) have been associated with significant morbidity and, in severe cases, mortality. Accurate forecasting of daily admissions of pediatric HFMD patients is therefore crucial for aiding the hospital in preparing for potential outbreaks and mitigating nosocomial transmissions. To address this pressing need, we propose a novel transformer-based model with a U-net shape, utilizing the patching strategy and the joint prediction strategy that capitalizes on insights from herpangina, a disease closely correlated with HFMD. This model also integrates representation learning by introducing reconstruction loss as an auxiliary loss. The results show that our U-net Patching Time Series Transformer (UPTST) model outperforms existing approaches in both long- and short-arm prediction accuracy of HFMD at hospital-level. Furthermore, the exploratory extension experiments show that the model's capabilities extend beyond prediction of infectious disease, suggesting broader applicability in various domains.Comment: No finished ye